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1.  Introduction 


The  concept  of  e  regenerative  stochastic  process  has  be com  an 
important  tool  in  applied  probability.  Pro*  its  theoretical  origin* 
in  work  of  DOEBLIN  (1938)  and  SMITH  (1955),  it  has  grown  to  play  a 
central  role  in  the  analysis  of,  for  exaaple,  queueing  systems  in 
light  traffic  and  sinulatlon  output  analysis;  see  IGLEHARX  (1971)  and 
CRANE  and  LEMOINE  (1978). 

In  the  Markov  chain  setting,  regenerative  analysis  has  simplified 
many  complicated  analytical  arguments  associated  with  the  limit  -theory 
of  such  processes.  A  significant  step  in  this  direction  occurred  with 
the  recent  papers  by  ATHRETA  end  NET  (1978)  and  NUMMELIN  (1978),  who 
showed  that  regenerative  process  theory  is  applicable  to  a  * 

significantly  larger  class  of  Markov  chains  than  previously  known. 

In  this  report,  we  shall  investigate  various  properties  of 
discrete-time  regenerative  processes  {XqJ.  We  start,  in  Section  2, 
by  defining  the  concept  of  a  regenerative  stochastic  process.  In 
contrast  to  many  other  treatments  (e.g. ,  (JINLAR  (1975)),  we  make  no 
requirement  that  regeneration  times  be  stopping  times  with  respect  to 
the  process  fields,  or,  in  fact,  that  they  even  be  measurable  with 
respect  to  the  process.  He  also  generalize  the  concept  of  a 
regenerative  process  to  allow  m-dependence  between  regenerative 
blocks;  we  call  this  class  of  processes  weakly  regenerative.  This 


class  turns  out  to  be  useful  In  treating  general  state  space  Markov 
chains;  see  [19]  and  [20]. 

In  Section  3,  ergodlc  theory  for  weakly  regenerative  processes  Is 

investigated.  We  prove  strong  laws  for  partial  stm  processes,  and 

»  • 

show  that  there  exists  an  "ergodlc''  measure  .it  which  captures  all  the 
"steady-state'"  information  of  the  process  {Xq}.  We  also  obtain 
a. a.  weak  convergence  for  the  empirical  measure  of  a  weakly  regenera¬ 
tive  process,  and  show  that  the  "renewal  paradox"  continues  to  hold  in 
this  generalized  setting. 

Section  4  is  concerned  with  construction  of  a  stationary  process 
from  the  ergodlc  measure  of  Section  3.  Total  variation  convergence  of 
the  measures 

n-1 

l  P(X.  e  *>/n 

k-0 

to  x  is  studied,  in  the  regenerative  setting,  in  Section  5. 
Furthermore,  rates  of  convergence,  in  terms  of  the  moments  of  the 
inter-regeneration  times,  are  obtained.  These  ideas  are  applied  in 
Section  6  where  it  is  shown  that  all  regenerative  processes  are  strong 
mixing,  and  that  regenerative  processes  are  uniformly  strong  mixing 
(^-mixing)  under  a  simple  sufficient  condition.  These  results  allow 
elementary  proofs  of  some  classical  mixing  results  of  DAVYDOV  (1973) 
for  Markov  chains,  and  Improve  the  results  in  the  sense  that  estimates 
for  the  mixing  constants  can  be  obtained.  Section  7  studies  the 
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central  limit  theorem  (CLT)  fzr  weakly  regenerative  proceasea;  thla 
result  can  be  used  to  obtain  a  new  CLT  for  Markov  chains;  see  [20], 

Ve  also  relate  this  CLT  to  a  CLT  for  the  corresponding  stationary 
process,  constructed  in  Section  4. 

Finally,  in  Section  8,  we  Investigate  the  splitting  property  of 
regeneration  times  (see  Jacobsen  (1974)  for  the  definition  of  a  split¬ 
ting  time)  for  a  special  class  of  Markov  chains*  A  regenerative 
process  is  said  to  be  strongly  regenerative  if  the  regeneration  times 
are  measurable  with  respect  to  the  o-fleld  genereted  by  the  process. 
For  the  class  of  Markov  chains  considered,  we  are  able  to  show  that 
all  strong  regeneration  times  are  splitting  times.  This  result  allows 
us  to  completely  describe  the  strongly  regenerative  Markov  chains  in 
the  class,  and  shows  that  when  such  a  Markov  chain  is  strongly  regen¬ 
erative,  then  the  regeneration  times  can  be  chosen  to  be  stopping 
time 8  with  respect  to  the  process  fields. 


2.  Definitions  and  Preliminaries 

Let  (X„:  n  _>  0}  be  a  stochastic  process  defined  on  a 

probability  space  (Q ,  G,  P) ,  and  taking  values  in  a  measurable  space 

(B,  JE).  A  ^-measurable  random  variable  (r.v.)  T:  Q  ♦  Z*  ■  (0,1,...) 

is  called  a  random  time.  For  any  two  random  times  T. ,T9  such  that 

k2 

Tj  <  Tj,  we  define  to  be  the  o-fleld  generated  by  all  events  of 

the  form  A  n  (Tj-T^  •  k},  where 
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(2.1)  DEFINITION.  A  process  {Xq:  n  >  0}  is  said  to  be 
regenerative  if  there  exist  random  times  0  *•  <  T£  <  •••  such 

that: 

T  -1 

i  * 

i)  the  a-ftelds  H  •  F_  are  independent,  for  n  >  0, 

-n  -Tq 

ii)  the  or fields  are  identically  distributed  for  n  1,  in 

the  sense  that 

,  ....  X-  +k_.)  «  B;  <c  -  k) 
n  n 

“  F{ (Xj  »  •••»  Ij  t  ®»  tj  "  k) 

for  each  B  in  the  product  o-field  &  E  *  •••  x  Z 
(k  times),  where  x  - 

The  random  times  Tj,  T2,  ...  are  called  regeneration  times 
for  the  process  {Xq:  n  ^  0} .  One  desirable  property  of  this 
definition,  in  analogy  with  the  case  of  independent  and  identically 
distributed  (i.l.d.)  r.v.'s,  is  that  the  process  {Z^  -«  <  n  <  0} 
inherits  the  regenerative  property  (with  the  obvious  generalisation  of 
(2.1)  to  time  parameter  set  {k:  -«  <  k  £  0}),  where  Zq  ■  X_n. 


(2.2)  FB0FOSZTI OB.  The  regenerative  property  is  preserved  under  time 
reverse!. 

Proof.  For  the  process  (Zq),  we  consider  the  rsndoe  tines  Sj 

given  by  -Tj+1,  and  pat  Sq  ■  1.  It  Is  easily  checked  that  the 

S  i-l  T-l 

generating  sets  of  FeJ  are  precisely  those  of  F_  .  This 

~Sj  "Tj-1 

Sr1 

Immediately  yields  the  conclusion  that  FeJ  are  independent  for 

“SJ+1 

j  ^  0,  and  Identically  distributed  for  j  >.  1*  I 

We  remark  that  one  of  the  classical  definitions  of  a  regenerative 
process  requires  that  the  random  times  Tj  be  stopping  times  with  • 
respect  to  the  family  of  increasing  c-fields  {F^:  n  0);  see,  for 
example,  ^INLAR  (1975),  p„  298.  Such  a  definition,  in  contrast  to 
ours,  does  not  have  the  time  reversal  property.  Furthermore,  It  Is 
clearly  a  limitation  to  require  that  the  be  Fq  measurable. 

(2.3)  EXAMPLE.  Let  {Zq:  n  _>  0}  be  a  finite  state,  irreducible 
Markov  chain  on  (0,  1,  ...,  m).  Then,  X  -  I,A,(Z  )  (I.(x)  ■  1(0) 

a  \\J)  a  A 

if  x  i  A (x  e  A))  is  a  regenerative  process  under  (2.1),  and  yet,  in 
general,  there  exist  no  F^  measurable  regeneration  times  for  XQ* 

As  we  shall  see  in  Section  5,  measurability  of  the  T^'s  has 
some  important  consequences,  motivating  the  following  definition. 
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(2.4)  DEFINITION.  The  process  {Xq:  n  >  0)  is  said  to  be  strongly 
rageneratlva  If  {Xq}  is  regenerative  and  the  regeneration  tlaee 
are  measurable. 

Applications  to  general  state  space  Markov  chains  in  [191  require 

t 

that  we  weaken  the  regenerative  property  somewhat. 


(2.5)  DEFINITION.  The  process  {Xq)  is  said  to  be  weakly 
regenerative  of  order  n  if  there  exist  random  times  Tj  such 
that: 

T  -1 

1)  the  c-fields  B  ■  F_  are  m-dependent  for  some  m, 

— n  — t 

n 

i.e. ,  the  o-flelds  H  and  H  . .  are  independent  for 
-it  -ntj 

j  mfrl, 

ii)  for  n  1  and  Jq  <  •••  <  J 


f{ (Xj  > 

n  ~n 


*T  4kJ  £  B;  Tn  "  J0 . Vi  "  Ji^ 


P{(XT^,  ...,  e  B;  Tj  -  jQ . Vifl  "  V 


for  each  B  in  the  product  <r-field  E*,  where 


Tn  Tn+1  ^n* 


(2.6)  PROPOSITION.  A  regenerative  procese  (Xq)  is  weakly 
regenerative  of  order  0. 
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1  k 

Proof.  We  need  only  chock  (2.5)  (ii).  Let  A  e  EJ  and  B  e  E  ,  and 
consider 


p(<*T_ . *r  +k+j-i)  e  A  *n  -  i*  Vi  "  k> 


-  p{ (X^.  ,  X,  j)  «  a;  tn  -  j} 

n  n  J 

‘  P{(XTn+1*  *•*»  ^T^+k-l*  €  B;  Tn+1  " 


>  •••»  €  A;  ■  j} 

•  P{(X^  .  •  •»*  ij  £  B;  Xj  *  k} 


»  •••»  e  A  x  B;  ■  J,  ^2  —  k^  * 


the  first  and  third  equalities  by  (2.1)(i),  the  second  by  (2.1)(li). 
An  easy  induction  argument  extends  the  above  equation  to  the  class  of 
rectangles  generating  (2.5)(il),  proving  the  result.  I 


We  now  examine  some  elementary  properties  of  weakly  regenerative 
processes. 


(2*7)  PROPOSITION.  Let  fj.  be  a  sequence  of  real— valued  functions 

such  that  im  &  measurable.  Then.  Y^-  f  (Z^,  ,  ....  X^,  ^  _j) 

n  n  n  ii 

la  H  measurable.  Hence,  the  r.v.'s  {(T  ,  x  ):  n  >  1}  are 
“H  n  n  — 

Identically  distributed,  and  m-dependcst. 


7 


Proof.  We  write  Yn  as 


(2.8) 


-  I 

k-0 


fk+l(XT 


XT  +kJ 
n 


<Vk+1> 


(note  that  (2.8)  is  a  finite  sum  for  each  u  e  Q),  and  observe  that 
each  summand  in  (2.8)  is  Hq  measurable,  so  that  Yn  is  Hq 
measurable.  I 


Certain  renewal  arguments  will  demand  the  following  result. 


(2.9)  PROPOSITION.  Suppose  that  {Xq}  Is  regenerative  and  that 
g  e  bE®,  where  bE™  is  the  class  of  real— valued  bounded  E®  ■ 
measurable  random  variables.  Then, 

»  t2  -  V«  -  **\**+>  p<*.  *  k> 

where  1  <  k  <  n,  and  ■  (1^,  Xj+j»  •••)  • 

ii)  ««<W=  Tio.)+i 

where  Jt(n)  ■  max{k:  n),  and  0  <  j  <  n. 


Proof.  For  (i),  write 

"*<VT1«>i  h  ■  V« 

"  E(g<\h>-k)i  T1  "  k> 


8 


and  observe  thee  gCV^+n-k)  measurable  with  respect  to  vj-2  Hj , 
the  minimal  e-field  generated  by  3^ ,  J  _>  2.  The  Independence  of 
from  this  o-field,  together  with  (2.5)(11),  yields  (1).  For  (il)t 
take  H  c  bF^  and  decompose  on  Jt(k)  as  follows: 


Ti(k)+1  -  k+J> 


k  k 


-  I  l  E{Wg(V  );  T  -  1,  t 
j-0  i-j  3  3 


-  k+j-1} 


k  k 


-  I  l  E{Hg(V  (  });  T  -  l;  x  -  k+J-1)  . 

j-0  1-j  xj+l  J'  J  J 


j 

Here,  W1 .  .  *■*  v  H.  measurable,  whereas 

i T j“l» i 

g(V  (  . . )  Is  v  measurable,  and  the  resulting  independence 

Tj+1 nn"3J  i-J+1 

proves  (1)  (use  the  defining  relation  for  conditional  expectation).  I 


3.  Ergodlc  Theory  for  Weakly  Regenerative  Processes 

A  weakly  regenerative  process  is  said  to  be  positive  recurrent  if 
Ex j  <  •  and  null  recurrent  otherwise.  In  the  remainder  of  this 
section,  we  assume  that  {X^}  is  a  positive  recurrent  weakly  regen¬ 
eration  process. 

Before  proceeding,  we  need  some  notation.  Let  bjJ  be  the  class 
of  bounded  real-valued  Z  measurable  functions,  and  let  ET*-  be  the 
cone  of  non-negative  E  measurable  functions.  For  E>  measurable 
real-valued  f,  put 
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The  following  theorem  extends  Theorem  7  of  SMITH  (1955)  for 

« 

cumulative  processes. 

(3*1)  THEOREM.  Suppose  either  that  f  «  E+  or  EYj_(  |f  |)  <  •. 

Then, 

n 

(3.2)  l  f(r)/n  -*«  BY  (f)/Ex.  e.s. 

k-0  11 

Proof.  First,  observe  that  by  Proposition  2.7,  {(Y_(f);  x  );  n  >  1} 

— — —  n  □  — 

Is  an  Identically  distributed  m-dependent  sequence.  For  f  c  the 
strong  law  of  large  numbers  implies  that 

<3'3)  Jo  *  ETl<,) 

as  1  ♦  for  J  ■  1,  ...,  mfl.  Averaging  (3.3)  over  j,  and  apply¬ 
ing  the  result  to  both  Yj(f)  and  Y^d),  shows  that 

1 

l  Y. (f )/T  >  EY . (f )/Ex 
k-0  *  *  1 


(3.4) 


a.s 


The  non-negativity  of  f  c  implies  that 

A(n)  n  A(n)+1 

(3.5)  ^  <  Jg  «V'«  <  ^  \CO/TlW  . 

Using  (3.4)  on  the  end  terms  of  (3.5)  yields  (3.2)  for  f  e  E+.  For 
f  satisfying  EYi(|f|)  <  ®,  split  f  into  f^x)  -  max{f(x),0} 
and  f'(x)  *  max{-f (x) ,0} .  Since  (3.2)  holds  for  f*  and  f~,  we 
obtain 

n  + 

(3.6)  l  f(X.)/n  •*  (EY.(r  )  -  EY.(f  ))/Et  . 

k-0  1 

t 

If  EYi(|f|)  <  «,  we  can  combine  the  expectations  on  the  right  side 
of  (3.6)  as  EYi(f)/ET1.  1 

The  following  example  shows  that  convergence  may  not  occur  under 
E|y1(f ) |  <  -. 

(3.7)  EXAMPLE.  Let  {Z^:  k  ^  0}  be  a  sequence  of  non-negative 
Independent  and  identically  distributed  (l.l.d.)  r.v.'s  with 
EZq  -  <=.  Put  X2k  -  Zfc,  and  X2k+1  -  -Zfc.  Then,  Tfc  -  2k  and 
Yk(g)  -  0  for  g(x)  -  x.  But 
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2k 

lQ  Yj(g)/2k  -  Z^k  +  •  *  EY^gJ/B-Cj  . 

The  convergence  of  Z^/k  to  infinity  is  implied  by  PfZ^  >  k) 

-  «,  and  the  Borel-Cantelli  converse. 

Let  it  be  the  set  function  on  E  defined  by  the  formula 


*2  A 

(3.8)  *(A)  -  E{  l  IA(Xk)}/E<c1  . 

k-Tj 

It  is  easy  to  show  that  it  is  countably  additive  and  thus  a 
probability  measure.  We  shall  use  the  notation  it f  to  denote 
/  f(y)  it(dy).  The  following  "representation'*  theorem  for  the 
"ergodic"  measure  it  is  valid. 

(3.9)  PROPOSITION.  If  jf  is  well-defined,  then 

(3.10)  wf  -  ETI(f)/Ex1  . 

Proof.  By  definition  of  it,  (3.10)  clearly  holds  for  all  simple 
functions  f.  For  f  e  bjl ,  f  can  be  uniformly  approximated  by  simple 
functions  fn  such  that 

lfQ-fl  -  sup{|fn(x)  -  f (x) | :  x  c  E}  <  1/n  , 

so  that 
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|*f  -  EYjCO/E^I 

-  |*(f-fn)  +  (*fn  “  Itjtt^/Btj)  +  EY^f-f^/Etjl 

♦  2lf-f  I  <  2/n  , 

n  — * 

and  hence  (3.10)  holds  £or  f  c  bE.  For  £  e  E+,  we  approximate  f 
by  bounded  functions  fn  Increasing  to  f ,  and  use  monotone  conver¬ 
gence.  For  a  general  f,  write  f  ■  f^-f- ,  and  observe  that  (3.10)  Is 
valid  for  f*-  and  f“.  I 

Consider  the  sequence  o£  empirical  probability  measures  defined 
by 


n 

Mq(A,w)  -  IA(Xk(u>))/(n+l)  . 

Our  next  theorem  concerns  the  a.s.  weak  convergence  of  Mq(  •,(!>). 

(3.11)  THEOREM.  Suppose  that  1!  la  the  Borel  o-field  of  a  separ¬ 
able  metric  space  E.  Then, 


M  (•  ,u)  — >  %(•)  a.s. 

n 

where  "">  denotes  weak  convergence  of  probability  measures. 
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Before  proceeding  with  the  proof,  we  need  to  discuss  the  notion 
of  week  convergence.  It  is  known  (see  BILLINGSLEY  (1968),  p.  12)  that 
Pn  — >  P  is  equivalent  to  requiring  tht  Pn(A)  +  P(A)  for  each 
A  such  that  P(3A)  ■  0,  where  3A  is  the  boundary  of  A.  For 

i 

separable  metric  spaces,  a  smaller  class  of  sets  A  characterizes 

weak  convergence.  Let  {sn}  be  a  set  of  points  dense  in  E,  and 

put  B(sa,e)  ■  (y:  p(sn,y)  <  e) ,  where  p  is  the  metric  on  E. 

Then,  observe  that  dB(sn,e)  =  (y:  p(sQ,y)  •  e),  and  hence,  for 

fixed  n,  the  boundaries  are  disjoint  in  e.  Thus,  for  each  n,  one 

can  find  a  sequence  of  numbers  e  +  0  such  that  P(3B(a  ,e  ))  »  0 

mn  n  mn 

for  all  m.  Let  A(P)  be  the  class  of  all  finite  intersections  of 
sets  B(sn,  enn). 

(3.12)  LEMMA.  If  Pn,  P  are  probability  meaaares  on  a  separable 
metric  space  K,  then  Pn  “>  P  Is  equivalent  to  Pn(G)  P(G) 
for  all  G  e  A(P). 

Proof.  First,  since  3(Gj  n  -  (5G^)  u  (ftG^),  it  follows  that 

P(3G)  ■  0  for  all  G  e  A(P)  and  thus  PQ  >  P  implies  that 

Pq(G)  ♦  P(G)  for  all  G  c  A(P).  Conversely,  observe  that  for  each 

x  e  E  and  c  >  0,  there  exists  m,n  such  that  B(s  ,e  )  -  B (x,e) 

n  mn 

and  thus  Corollary  1,  page  14,  of  [3]  applies,  completing  the  proof.  I 

Note  that  A(P)  ■  A^(P),  where  A^(P)  is  the  class  of  all 

intersections  of  i  sets  of  the  fora  B(sa,ean).  Since  each 
Ai(P)  is  countable,  A(P)  is  countable. 
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Proof  of  Theorem  3.11.  Since  A(P)  is  countable,  it  follows  that 
{u:  Mq(«,u)  ->  *(•)}  is  G-measurable ,  by  Lemma  3.12. 

Furthermore,  this  set  has  probability  1,  since 

P{d>:  Mq(G,uj)  -*■  u(G)  for  all  G  c  A<it)>  -  1  , 

using  Theorem  3.1  and  Proposition  3.9.  I 

(3.13)  COROLLARY.  Let  E  be  a  separable  metric  space,  and  let  bC 
be  the  class  of  E  continuous  functions.  Then, 

n 

P{w:  l  f(X.  (u))/n  +  %£,  for  all  f  e  bC>  -  1  . 

k-0 

Thus,  for  weakly  regenerative  processes,  one  can  obtain 
simultaneous  convergence  in  (3.1)  over  a  large  class  of  functions, 
namely  bC  (this  simultaneous  convergence  can  not  be  extended  to  bjl, 
except  when  x  is  atomic). 

In  addition  to  strong  laws  such  as  (3.1),  weakly  regenerative 
processes  also  have  behavior  characteristic  of  the  so-called  "renewal 
paradox." 

(3.14)  PROPOSITION.  Suppose  either  that  f  <  Z*  or  ExjY^jf  |)  <  •. 
Then, 
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(3.15) 


a.a. 


I 

k-0 


Tl(k)(£)/“  *  *Vl(£>/Exl 


Proof.  7or  f  e  E*,  observe  that 


I 

k-0 


W£)/T*n) 


i(n)-i  Tk+l_1 


I 

k-0 


3“T. 


TKj)(f)/Tl(n) 


Jl(n)-1 

*  lmQ  %Vf)/Ti( n)  *  EW£)/E*l  ‘ 


a.s.  (Co  deal  with  the  m-dependence ,  average  as  In  the  proof  of 
Theorem  3.1).  Now,  repeat  the  reasoning  of  (3.5)  through  (3.6)  to 
complete  the  proof.  I 

In  particular,  the  “ t ime-ave raged “  length  of  the  epoch 
2 

Tl(n)+l”  TX(n)  18  **  in  the  regenerative  case. 


4.  Stationary  Regenerative  Processes 

Associated  with  every  weakly  regenerative  process  Is  a  closely 

related  stationary  process;  see  BROWN  and  ROSS  (1972)  for  a  discussion 

In  the  regenerative  case.  We  start  by  proving  a  strong  law  for 

functionals  of  the  form  g(X  ,  ...,  X  ),  where  g  Is  a  real-valued 

n  nrx 


IS*"*’ '  measurable  function.  In  preparation  for  stating  the  result,  we 
extend  the  notation  Yn(f  )  from  scalar  functions  f  to  functions 
g  of  a  vector  argument: 


YQ(g) 


n+1  * 

I 

k-T 

11 


«<V 


W- 


(4.1)  PROPOSITION.  Suppose  either  that  g  e  (E*+1)+  or 
|sf >  <  ••  Then, 

n 

(4.2)  l  g(Xk,  ...,  X^p/n  -»•  EY1(g)/Ex1  a.s. 


Proof.  Let  0^  "  (X^,  ....  Xj^)  >  and  recall  that  X^  Is  weakly 
regenerative  of  order  m,  with  respect  to  some  sequence  of  random 
times  Tj.  It  Is  easily  verified  that  Ufc  is  then  weakly  regen¬ 
erative,  of  order  nri-X,  with  respect  to  the  same  times  Tj.  The 
limit  theorem  (4.2)  is  then  obtained  as  an  Immediate  consequence  of 
Theorem  3.1.  I 

The  following  result  shows  that  weakly  regenerative  processes 
have  a  "shift  invariance"  property. 

(4.3)  PROPOSITION.  Suppose  either  that  g  e  (K*fl)+  or 
Ri(|gj)  <  ••  Then, 
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T2-l  t2+i-i 

(4.4)  *{  l  gCX^  ....  “  E(  I  —• 

Mj  Wjij 

for  any  j  >  0. 

i 

Proof .  Since  Is  weakly  regenerative  (see  proof  of  (4.1)),  we 

have  that 

Vr1+j 

(4.5)  l  g(Xk . )/n  +  *Vg) 

k-Tj+j 

if  gc  bE*+1.  Now,  the  left-hand  side  of  (4.5)  Is  dominated-  by 
I gl (T^  -T^)/n,  which  converges  to  IglEx^.  But 

,<VrV/o  •  S 

and  hence  ((Tn+i-T^/o;  n  1}  Is  uniformly  Integrable.  It 
f ollowa  that  the  left-hand  side  of  (4.5)  is  uniformly  integrable,  and 
thus  we  may  take  expectations  of  both  sides  in  (4.5)  (see  CHONG 
(1974),  p.  97).  Application  of  (2.5)(11)  then  proves  (4.4)  for 
g  e  b(£f+l).  A  standard  approximation  argument  give*  (4.4)  In  the 
general  case.  I 

We  now  define  the  associated  stationary  process  Yn.  For 
A  c  E*,  define  the  measure  P*  on  E"  by  the  formula 
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p.(A>  -  i(  I  i/v  Vr  -W'n  • 

Let  Ta  be  the  coordioete  projection  of  E®  onto  its  n'th 
coordinate,  for  n  0. 

(4.6)  THEOREM.  The  process  {Tn:  n  >  0}  is  stationary  with 
respect  to  the  probability  P*. 


Proof .  It  is  sufficient  to  prove  that 

P{(YQ,  Y^)  c  A}  -  PKTj.  •••,  Tj+a)  c  A>  for  all  A  e  E**1  . 

But  this  result  follows  immediately  from  Proposition  4.3.  I 

In  this  case  where  {XqJ  a  >  0}  is  regenerative,  it  is 
particularly  simple  to  prove  that  the  stationary  process  {Yn>  can 
be  constructed  directly  from  the  {Xq}  process,  in  the  following 
sense.  We  assume  that  (Q,£,P)  is  a  sufficiently  rich  probability 
space  that  it  supports  r.v. *s  g 1 ,  g^  independent  of  {(Xn,Tk): 
n,k  >  0}  with  distribution 


P{px  -  k.  02  •  J>  -  PUj  -  kJ/E^  I{j<k}(j) 


Let  ri(k)  «  inf{n  >  Is  x  •  k)  and  put  ot"T,ax  +  B„ 
—  a  mPi>  2 
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(4.7)  PROPOSITION.  If  {Xg;  n  ^  0}  Is  regenerative,  then  the 
process  (1,^  k  >,  0}  has  the  sene  distribution  on  E"  as 
(V  k  >  0). 

i 

Proof.  For  B  c  E*+*, 

(4.8)  P((Xa,  X^)  «  B) 

"  Jl  j-0  PUT’<k^’  ***’  VkHj+i5  e  B}  P{T1  "  k}/ETl 

Now, 

(4.9)  p<(XT,(k)+j'  Xn(k)+j+A)  e  B} 

m 

"  p{(*rn+j*  35rn+j+i)  B; 

*  k . tn_l  *  k,  tn  -  k) 

-  J  p{<XTi+j . XT14j+i)  c  T1  ■  k>  P^1  11  k>*’1 

-  P{(XT  ...,  X.J.  ^+Jl)  s  Bj  tj  ■  kJ/PfTj  -  k)  , 

where  the  second  equality  follows  froe  (2.1)(i)  and  (2.5)(11). 
Substituting  (4.9)  into  (4.8)  and  using  Fubiti  proves  that 
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P{(Xa,  ....  Xflt+A)  e  B> 

•  k-1 

-  I  l  . *r +W  «  B*  *1  "k>/E*i 

n-l  j-0  Tlrj  M  -3  *  1 

-  j0  J+1  P((XT^ . *  *1  "  k)/ETl 

"JoP{(Vj . Er1+j+x)  «  BJ  *i>j>/Eti 

V1 

“  ®{  J  -M  1  ***»  ii  i  J  * 

1  j“Tj  Tl^  V3*1  1 

proving  Che  result.  I 


As  one  might  expect,  the  process 
with  respect  to  the  rsndoe  Claes  Tq  • 
Furthermore,  ss  is  easily  checked. 


(X^^:  k  ^  0}  Is  regenerative 
*’  *k  "  Th<Pi)-Hc’  k“  2‘ 


(4.10)  P{(X^,  ,  ... ,  Xj,^)  t  Bj  t|  ■  Jq ,  «.., 

“  P{(XT1 . ^Tj+k5  e  B;  T1  "  30 . TJt+l  "  V 

where  -c'  “  T'  , -T'.  However,  the  first  epoch  of  (X  .  :  n  >  0)  has 
n  nti  n  or™ 

a  markedly  different  distribution  from  that  of  {Xq:  n  .>  0}. 

Observe  that  for  B  e  E***,  we  have 
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X+l} 


(4.11)  P{(X_, ,  ...» 
0 


CD 

■  I 

k-1+1 


CO 

*  l 

k-1+1 


«  B;  To  ‘ 

p{(Xn(k)+k-i-i’  *• 
P^(XT1+k-l-l . 


-  Xr,(k)+k-l>  ‘  B>  P{T1  "  k>/E"l 

Xri+k_i>  e  3;  xl  kJ/E-Cj 


-  Pfttj  A_lt  ...»  Xf  _j)  «  B;  xj  >  A+lJ/E^  . 

This  result  will  prove  useful  in  Section  6,  when  we  shall  examine 
mixing  conditions  for  regenerative  processes.  Formula  (4.11)  also 
leads  directly  to  the  observation  that  a  stationary  regenerative 
process  {X^  -®  <  n  <  «}  has  the  same  distribution  as  its  time 
reversal  {Z^  -«•  <  n  <  -}  if  and  only  if  for  all  B  c  _E*+1, 

(4.12)  p{(XTl+i'  •••»  *t  }  £  B;  *i  >  1+1} 

“  P{(*T  •••»  e  B;  1+1}  . 


5.  Total  Variation  Convergence  for  Regenerative  Processes 

By  Theorem  3.1  and  the  bounded  convergence  theorem,  it  follows 

that 
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(5.1) 


l  Ef(X.  )/n  ♦  wf 
k-0  * 

for  oil  f  e  bE.  One  of  our  aaln  goals  in  this  section  Is  to  show 
that  the  convergence  in  (5.1)  Is  unifora  over  f  e  bE  such  that 
*  f I  .<  1,  and  that,  under  certain  conditions,  (5.1)  holds  without 
averaging.  Such  uniform  convergence  Is  equivalent  to  total  variation 
convergence  of  the  corresponding  Measures. 

In  analogy  with  Markov  chains,  we  say  that  a  weakly  regenerative 
process  {Xn:  n  0}  Is  periodic  with  period  p  If  the  span  of  the 
distribution  of  is  p.  If  the  period  Is  1,  then  {Xq}  Is 

said  to  be  aperiodic.  For  g  e  b(E“),  put 

C 

v(g;n)  -  Eg(VT  +q)  for  n  >  0  . 


(5.2)  THEOREM.  Let  {Xq}  be  an  aperiodic  positive  recurrent 
regenerative  process.  Then,  there  exist  constants  yn  -*•  0  such 
that 

•UP  U(g;n)  -  E*g(T)|  -  y 

where  E*  denotes  expectation  with  respect  to  P*.  If  Er*  <  •,  then 

r.  ■  *.•’>. 

Proof.  We  start  with  a  renewal  arguaent,  naaely 
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(5.3)  v(g;n)  -  J  EU<vTi+n>5  T2  "  Ti+k}  +  Ete<VTl+n);  T2  >  V*} 


■  Jl  E,g('V-l‘)1  P{T>  ■  k)  +  E(g(VT1+n)i  '1  >  "> 


=  l  v(g;  n-k)  P{t  -  n-k)  +  a(g;n)  , 
k-1  1 


when  the  second  equality  Is  by  Proposition  2.9  (1).  The  solution  of 
this  renewal  equation  is 


(5.4)  v(g;n)  -  J  a(g;  n-J)  u 

j-0  3 


where  u^  -  P{ij  +  ***  +  ■  j}  (see  KARLIN  and  TAYLOR  (1975), 

p.  184).  The  renewal  theorem  (FELLER  (1950),  p.  330)  asserts  that 


(5.5) 


v(g;n)  +  l  a(g;j)/Et, 
j-0 


Note  that  a(  g  ;  j)  I gfl  p{tj  >  j},  so,  by  Fubini's  theorem. 


(5 


.6)  l  a(g;j)  -  E{  \  g(V  )  I{  > 

j-0  j-0  Al~  'lJ' 


V1 


E{  I  g(V  )}  -  E*  g(Y) »Ex 
j-Tj  3 


Combining  (5.4)  through  (5.6)  shows  that 
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(5.7)  v(g;n)  -  E*g(Y) 


<  »gi  l  P{t,  >  J>  U  4  -  (Exf1!  +  Igi  l  p(x.  >  j>  . 

j-0  1  '  n  J  1  j«n+l 

We  now  use  an  escimace  of  GEL' FOND  (1964)  for  Che  error  in  Che  renewal 
theorem,  namely 

(5.8)  u  -  1/Ex  +  o(n1-K) 

n 

which  is  valid  under  Che  assumpCion  Ex  ^  <  ®.  This  implies  chaC 

Kx  -  sup{  |  u j  -  1/Ex  | :  j  )  x}  *  o(x*  *) 

Substituting  this  relation  in  (5.7)  yields 

|v(g;n)  -  E*g(Y)| 

<«gl(  l  Ptx^jJ+K.,) 
j>n/2  1  W 

<lgl(nH  l  j*'1  P{x,  >  J>  +  K/2) 

j>n/2 

-  «gl(n1  K  o(l)  +  otn1  *))  -  Igl  oin'  K)  , 
the  second-lasC  equality  because  Exj  <  •.  I 

25 


-  : ,  W- rott W*.t  *£> 


Theorem  5.2  considers  Che  time-dependent  behavior  of  Xq  for 
n  Tj.  Our  next  result  deals  with  Xq  over  semi-infinite  time 
intervals  with  deterministic  time  origin. 

(5.9)  PROPOSITION.  If  {Xq:  n  >  0}  is  an  aperiodic  positive 
recurrent  regenerative  process,  then 


|E<«<W|lo>  -  ***<*>  | 

<  lgl(l  +  y(0))  p^Tx(k)+l  “  k  *  +  ,gl  »•»•* 

where  yC*)  ”  j  >  x}  for  i  >  0  (put  y(x)  ”  0  for 

x  <  0). 

A 

Proof.  Let  g  ■  g  -  E*g(Y) ,  and  note  that 

Ie<»<w|iS>I 

<  |E(g(Vk+n):  rt{k)+,  <  W.|jJ)|  +  .g>  P(T1<k)+1  -  k  >  «|lS> 

For  the  first  term,  we  use  Proposition  2.9(11)  and  Theorem  5.2  to 
obtain 
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|e{ v(g;  n  +  k  -  Tx(k)+1);  Tl(k)+1  <  W*|fJ>| 

<  Igl  E{Y(n  +  k  -  T1(k)+1);  -  k  <  n|pj} 

<  Igl  E{y(n  +  k  -  Tl(k)+1)j  -  k  <  n/2|p£) 

+  Igl  Y(0)  P{TJl(k)+1  -  k  >  n/2|pjj} 

<  Igl  (Y(n/2)  +  Y(0)  P{T£(k)+1  -  k  >  n/2|j£» 
proving  the  proposition.  I 


It  should  be  noted  thst  the  asymptotic  nature  of  Yn  under 
Et*  <  <■  is  Inherited  by  Y(x),  namely  Y(x)  ■  0(x*  K). 

(5.10)  COROLLARY.  (1)  If  (l*)  Is  an  aperiodic  positive 
recurrent  regenerative  process,  there  exist  constants  i  0  such 
that 

(5.11)  sup  |EgCV_>  “  E*g(Y)|  -  a  . 

Igl  <  1  1  1 

The  constants  «n  are  dominated  by  (14y(0))P{Tj  >  n/2)  +  y(n/2). 

(11)  If  (E,B)  is  a  separable  aetrlc  space,  the  process 
(Zq,  Xq+i ,  ...)  converges  weakly  to  the  stationary  process  Y  In 
the  product  topology  on  E“. 
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Proof.  Part  (i)  follow*  immediately  from  Proposition  5.9.  For  part 
(ii),  it  is  necessary  only  to  realize  that  for  a  separable  metric 
apace  E,  the  product  field  P”  coincides  with  the  Borel  sets  under 
the  prod-ict  topology  (see  DELLACHEBIE  and  MEYER  (1978),  p.  9).  I 

The  periodic  case  can  be  reduced  to  the  aperiodic  situation 
above,  without  difficulty.  If  {Xq:  n  _>  0}  is  a  periodic  positive 
recurrent  regenerative  process  with  period  p,  set  Uq  -  (Xq ,  ..., 
and  put 

°i  "  ^-Ki-Dp . XT1+ip-l)  ' 

The  process  {U^:  i  0}  is  regenerative  with  respect  to  the  random 
times  VQ  -  0,  T^  -  1,  T^  -  T'  +  x^p,  ...»  r  -  r_x  +  x^/p. 
Clearly,  the  distribution  of  x^  *  Xj/p  has  span  1,  and  hence  {1^} 
is  aperiodic.  We  therefore  immediately  obtain  the  following 
genera1 lzation  of  Proposition  5.9. 

(5.12)  PROPOSITION.  If  {I„:  n>  0}  is  a  positive  recurrent 
regenerative  process,  then  there  exist  constants  t  0  such  that 

i*r<  i  i3L  ■  ***<t>i  ■ k.  • 
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These  results  have  immediate  applications  to  general  state  space 
Markov  chains  (see  p.  8-25  of  R£VUZ  (1975)  for  definition,  notation, 
and  basic  properties).  A  Markov  chain  {Wa:  n  >  0},  with  transition 
kernel  Q  defined  on  measurable  space  (E,E),  is  called  Harris 
recurrent  if  there  exists  a  set  A  c  E,  an  integer  k,  and  a 
probability  $  on  (E,E)  for  which 

(i)  Q  {W  e  A  i.o.)  -  1  for  all  x 

Xx  n 

(5.13)  . 

(ii)  Q  (x,«)  X.$(«)  for  all  x  c  A,  where  A,  is  positive. 

In  the  case  where  k  -  1,  ATHREYA  and  NET  (1976)  and  NUMMELIN  (1978) 

have  shown  that  for  each  ji  on  (E,E)  the  process  {WQ}  can  be  . 

embedded,  with  marginal  distribution  Q^,  in  a  probability  space 

(Q,G,Q  )  for  which  {W  }  is  regenerative.  Furthermore,  the 

n 

regenerative  process  (Wn)  is  positive  recurrent  if  and  only  if  Q 
has  a  unique  Invariant  probability  x,  in  which  case  x  coincides 
with  that  given  by  (3.18).  The  basic  idea  behind  the  regenerative 
embedding  is  to  "split**  Q  as 

(5.14)  Q(x,»)  -  \$(»)  +  (1-A)  R(x, •) 

over  x  c  A.  A  transition  out  of  A  is  distributed  with  probability 
\  as  $(•)  (a  regeneration)  and  with  probability  l-\  as  R(x, •). 

Proposition  5.9  provides  an  easy  proof  of  the  following  result 
(see  ATHREYA  and  NET  (1978)). 
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(5.13)  PROPOSITION.  If  {t^)  is  a  Harris  chain  with  invariant 
probability  %,  and  if  k  ■  1  in  (5.13),  then 

aup  Is  g(W  )  -  *g|  ♦  0  for  all  p  . 

Igl  <  1  1  *  n  1 

The  general  convergence  results  for  Harris  chains  can  be  obtained  fron 
(5.15)  in  a  reasonably  straightforward  way;  see  ATHREYA  and  NET 
(1977). 
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(6.3)  IHBOint*  (1)  If  {Xq}  is  an  apariodlc  positive  rnearraat 
regenerative  process,  than  {Xq}  la  atrong  nixing. 

(11)  If,  In  addition  to  the  above  hypotheses,  there  exists 
c(x)  f  0  such  that 

•J»P  p<T1(k)+l  “  k  >  ®|l5>  <  c(n)  e.s., 

than  the  process  {Zg}  Is  uniformly  strong  nixing. 

tr 

Proof.  For  (i) ,  let  V  be  a  nonnegative  bounded  Fq  measurable 
r.v. ,  and  take  g  c  blS*.  Then,  by  Proposition  5.9,  * 

(6.4)  EWg(Vk+n)  -  EtWStgCV^)  |fJ» 

<  IWI  Igl  (O+y(0))  P{Tl(k)+1Ht  >  n/2)  +  y(n/2)) 

Of  course, 

(6.5)  |EWg(Vk+n)  '  EWEg(VkHl)| 

<  |EWg<Vk+n) |  +  EW|Eg(Vk+n)  ~  E*g(Y)| 

<  |Ewicvfc+n)|  +  IWI  lglan  . 
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the  second  inequality  by  (5.11).  Using  (6.4)  and  (6.5),  it  is  clear 
that  the  proof  of  (6.3)(i)  is  therefore  complete,  provided  that  me  can 
show  that 


P{Tl(k)+l  -  k  >  n>  ♦  0 


as  n  -*■  •  , 


uniformly  in  It.  Now,  observe  that 


(6.6)  P{Tl(k)+l  ’  k  >  n} 


<  P{tQ  >  fcfn}  +  P{TJl(k)+1  -  k  >  n;  JL(k)  >  0} 


The  second  term  can  be  written  as 


(6.7)  ^  P(Tt(k)+1  *  k  >  Oi  t,  -  1) 


lml  P(I«I1+k-J)+l  '  «!*-»  >  “!  T1  *  » 


lml  P<Tt(T1«1-jHl  '  «1*1>  >  •>  P(T1  "  •» 

1 1  <T<  k  F<Tjt<v*> ' <VJ)  >  .  • 


The  final  term  in  (6.7)  is  amenable  to  a  renewal  argument,  which  shows 
that 


(6.8) 


P{T 


KTj+j) 


-  (T  4j)  >  n)  -  |  P{t.  >  nfj-k) 
k«0 
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where  the  right-hand  side  of  (6.8)  converges 

60  lk>0  P{T1  > 

The  boundedness  of  P(ti  >  nfj-k)  allows  us  to  use  sn  argument 
slaller  to  that  of  Theorem  5.2,  to  prove  that  (6.8)  converges  to  0 
as  a  ♦  •,  uniformly  In  j,  completing  part  (i). 

For  (ii) ,  write 

(6.9)  |EVg(Vk+li)  -  EWEgCV^I 

<  |E{WE{g(Vk+n)|Fj))|  +  -  E*gW| 

<  Igl  EW((l+y(0))  c(n/2)  +  y(n/2)  +  aQ)  .  I 


We  now  examine  the  fora  of  the  strong  mixing  constants  a(n)  for 
the  stationary  regenerative  process  (Yn:  n  >_  0} . 

(6.10)  PROPOSITION.  If  {Xg}  ie  an  aperiodic  positive  recurrent 
regenerative  process  with  B?*  <  •,  then  {!„}  Is  strong  adzing 
with  constants  «(n)  ■  0(0*“*). 

Proof.  Let  -  (Y^,  Yk+j,  ...)  and  observe  that  Eg(Vk)  -  Eg(VQ) 

■  E*g(Y),  by  statlonarlty.  Thus, 

|W8(Vkrt)  -  BB.UW  | 


<  IWI  Igl  (l+y(0))  P{T* ..  v . ,  -  k  >  n/2)  +  y(n/2) 


(see  (6.4),  (6.5),  and  (4.10)).  We  now  us*  (6.6)  to  bound 
P{TA00+1  “  k  >  n/2*‘  notin*  that 

P{x'  >  fc+n>  <  l  P{x.  >  JJ/Kr.  <  nW  J  j*"1  P{x.  >  J}/Et 

g  J-n  1  1  j-n 

-  oU1-*)  . 

For  the  second  ten  In  (6.6),  we  recall  that  uQ  ■  1/Ex  +  o(n^~K) 
and  apply  the  argument  of  Theorem  5.2  to  (6.8);  the  resulting  rate  of 
convergence  bounds  the  second  ten  through  (6.7).  I 

As  In  Section  5,  Markov  chains  provide  an  Interesting  class  of 
examples . 

(6.11)  PROPOSITION.  Set  {¥  :  n  >  0)  be  a  Harris  chain,  possessing 

n  ~ ■ 

an  Invariant  probability  s,  which  Is  aperiodic  as  a  Markov  chain. 
Then,  {Hq}  Is  strong  mixing  for  arbitrary  Initial  distribution  |k 

Proof.  Let  A  and  k  be  as  In  (5.13).  Because  {Wn:  n  0)  Is 

an  aperiodic  Markov  chain,  it  follows  that  visits  A 

lnflntely  often  a.s.  (see  Lemma  2.1  of  [27]),  and  hence  (W^v) 

A 

is  regenerative  under  a  measure  consistent  with  Q^.  Assuming 

that  the  regenerative  process  {Wg^}  has  period  p,  let  Xg  » 

(Wns;  n  _>  0)  where  s  *  pk.  The  skeleton  Xg  is  a  positive 
recurrent  regenerative  process,  since  wns  is  a  Harris  chain  with 
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Invariant  probability,  and  tharafora,  by  Thaorea  6.3(1),  strong  nix¬ 
ing.  Lat  a  -  as+J,  n  "  bs+l,  where  0  £  J,  X  <  s  and  a  <  b  and 
consider 

(6.12)  Q^(BC)  -  Q^(B)  Q^C) 

where  B  e  £(Wq,  •••♦  WB)  «nd  C  e  £(Wq,  •••)•  Using  the 

Harkov  property  of  Hn,  it  is  easily  seen  that  these  two  sub-cr- 
flelds  are  conditionally  independent  given  ^W(a+i)8»  Wbs^  (see 
Theorem  45,  p.  36,  of  [12])  and  hence 

V*cK«m>.’  "b.» 

*  V‘1%-1)-'  Vcl“(.+D.'  “t.’ 

-  Vclwb-> 

(using  the  Markov  property  of  reversed  chains).  Thus,  (6.12)  can  be 
written  as  the  covariance  between  functions  of  Xg+j  and  Xf,,  and 
so  the  strong  nixing  result  for  (X,)}  can  be  directly  applied  to 
obtain  (6.1)  for  {Wn},  Furthermore,  it  is  clear  that  the  mixing 
constants  for  {Wn}  are  given  by  a(n/s),  where  a(n)  are  the 
constants  for  (Xq).  1 

Proposition  6.11  gives  a  regenerative  process  proof  of  Theorem  1 
of  DAVYDOV  (1973).  Furthermore,  our  approach  allows  us  to  obtain 


estimates  for  the  strong  mixing  constants  for  stationary  aperiodic 
Harris  chains.  In  particular,  by  applying  Proposition  6.9  and  6.10, 
we  see  that  a(n)  *  o(n  ),  provided  Et^  <  ®,  where  tj  is  a  r.v. 
with  the  distribution  of  the  Athreya-Ney-Nummelin  regeneration  time. 

It  is  also  worth  applying  our  regenerative  results  to  Doeblln 
recurrent  Harkov  chains.  A  chain  {WQ}  is  said  to  be  Doeblln  If 
there  exists  e  >  0  and  a  finite  nontrivial  measure  v  such  that 

v(B)  <  e  — >  Qk(x,B)  <  1-e  , 

for  some  k  (see  D00B  (1953)  for  a  complete  discussion).  If  11  is  a 
separable  o-field  (i.e. ,  countably  generated)  and  if  { Wn )  has  a 
single  ergodic  set  (see  p.  209  of  [14]  for  definitions),  then  (VQ) 
is  Harris  recurrent  (see  Lemma  4.6  of  [18]). 

(6.13)  PROPOSITION.  Let  (Nq)  be  an  aperiodic  Doeblln  chain  with 
single  ergodic  set,  and  assume  that  K  la  separable.  Then,  (Nq) 
la  uniformly  strong  mixing  with  uniform  mixing  constants  +(n)  ■ 
o(n-k) ,  for  any  k  >_  1. 

Proof.  We  apply  Lemma  4.7  of  [18],  which  shows  that  there  exists  m 
such  that 

»up  (^{^  >  m>  <  1  , 

X  €  E 
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where  A  is  es  In  (5.13).  Then,  using  Che  argument  of  Theorem  4.1  of 
[1]  shows  Chet 


(6.14)  sup  Ex{TA(k)+1  -  k  >  n)  -  0(p“) 

x  c  E 

when  0  <  p  <  1  end  Che  T^'s  ere  Che  regeneration  times  of  WM 
(see  proof  of  (6.10)).  The  proof  of  uniform  strong  mixing  is 
completed  by  using  (6.14)  in  conjunction  with  the  Markov  property  and 
Theorem  6.3(ii).  To  obtain  the  estimates  for  <fr(n) ,  one  applies 
(6.14)  to  (5.2),  (5.11),  and  (6.9).  I 

r 

The  above  result  can  also  be  found  in  [11]  (Theorem  2),  proved  by 
a  different  method. 


7.  The  Central  Limit  Theorem  for  Weakly  Regenerative  Processes 

Let  {Xq!  n  0}  be  a  positive  recurrent  weakly  regenerative 

process,  and  let  f  be  a  real-valued  ^-measurable  function.  Ve  now 

wish  to  investigate  the  behavior  of  ‘'normalized’*  sums  of  f(Xn)'s. 

Assume  that  it|f|  <  •  (x  given  by  (3.8)),  and  let 

f(X  )  -  f (X)-xf . 
n  n 

(7.1)  THEOREM.  Let  (Zg)  be  a  positive  recurrent  weakly 
regenerative  proceee ,  and  suppose  that  0  <  o  (Tj(  fj))  <  •.  Then, 
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(7.2) 


where 


l  £(X.  )/n1/2  — >  H(0,  a2) 
k-0 


a 2  Ex.  -  o2(T  (f))  +  2  l  covCYjd).  T^id))  • 

1  k-1 


Proof.  On  (Ti  <  n> ,  we  can  write 


(7.3) 


I 

k-0 


f(X  )/n1/2  -  Y  (f)/n1/2  +  l 
k  0  k-1 


Yk(f)/n1/2  +  RQ(f)/n1/2 


where 


Rn(f) 


n 

l 

k-T^(n) 


!(Xk)/n 


1/2 


A 

The  tern  R  (f)  can  be  bounded  as  follows: 
n 


«  .  1/2 

(7.4)  |Rn(f)|  <  max{Yk(|f|):  0  <  k  <  n(mH)}/n 

A  l/  2 

0  j  <  n+1 

A 

Since  {YQ(jf|)}  is  nr-d^pendent ,  it  follows  tht  tY(arn)k+j(  |f  |  ^ : 
k  >  0}  is  an  i.i.d.  sequence  of  r.v. ’s  with  common  finite  variance. 


38 


Thus,  by  Che  Borel-Cantelli  lemma 


a.s. 


Hence,  for  each  e  >  0,  there  exists  n(e)  such  that  for  all 
k  >  n(e) , 


vwr‘i>*w  < e  • 


So,  for  k  >  n(e) 


11m 


o  <T<  k 


1/2 


<  lim  max  n  ,(|f|)/k 

0  <  i  <  n(e)  i(ffl+1)  j  I  I 


1/2 


+  11m  max  Y  (  I f  I  )/l 

n(e)  <  i  <  k  i(nrfl)+j  1  1 


1/2 


<  e  , 

A 

and  thus  |RQ(f ) |  0  a.s.  We  now  use  a  technique  employed  by  CHUNG 

(1967)  to  deal  with  the  second  term  in  (7.3).  Let 

b(k)  ■  max{j:  j(nH-l)  Et^  £  k) 
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and  put  k'  ■  b((l-e^)n),  k*  ■  b(n),  k“  ■  b((l+e^)n)  for  e  >  0. 
Since  A(n)/n  1/Exj  a.s.  (this  can  be  proved  by  averaging  as  in 
(3.3)),  it  must  be  that  there  exists  n(e)  such  that 


A  ■  {k* (nrt-1)  <  i(n)-l  £  k"(nri-l)  for  all  n  n(e)} 
has  probability  at  least  1-e.  On  A. 


i(n)-l 

a 

k*(nH-l) 

I 

Y,(f) 

-  I 

j-l 

J 

j-l 

m 

£ 

2  I 

max 

i-0  k'  <  j  <  k 


Yj(f) 


fYp(nri-l)+i(^| 


The  Kolmogorov  Inequality  applies  to  each  individual  "max"  term,  and 
thus  it  follows  that 


max 

k'  <  J  <  k" 


ww;>l/k*1/2 


+  0 


in  probability.  Hence, 


A(n)-1  A  k*(m+l)  A 
(  l  T  (f)  -  l  Y  (f))/k*1/Z  -  0 
j-l  J  j-1  3 
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in  probability.  Applying  the  central  limit  theorem  for  m-dependent 
sequences  (see  [3],  p.  174)  shows  that 


l  Y.(f)/k*1/Z  ->  N(0,  a  Et. (nri-1)) 


The  proof  is  finished  by  using  the  "converging  together"  lemma  (see 
p.  25  of  [3])  and  observing  that 


k*/n  1/ (nrt-1)  E-r1  .  I 


It  is  worth  pointing  out  that  in  the  regenerative  case,  Chung's 

proof  (see  p.  100  of  [6])  shows  that  the  central  limit  theorem  (CLT) 

2  * 

holds  under  the  slightly  weaker  assumption  that  0  <  a  (Y^(f))  <  «. 
Theorem  7.1  also  leads  to  a  new  CLT  for  Harris  chains,  in  light  of  the 
fact  that  Harris  chains  are  weakly  regenerative  (see  [19],  Proposition 
4.11).  For  other  versions  of  the  Harris  chain  CLT,  see  OREY  (1959), 
COGBURN  (1970),  and  MAIGRET  (1978). 

As  is  well  known  in  stationary  process  theory,  the  variance 
constant  for  partial  sums  of  the  form  (7.2),  coming  from  a 

stationary  process  {Y^},  is  generally  given  by 

«jZ(f(Yn))  +  2  l  cov(f(Yn),  f(Y.  ))  . 

u  k-1  u  it 


(7.5) 


Let  {Yi>  be  a  stationary  positive  recurrent  regenerative  process, 

and  observe  that,  under  certain  moment  conditions.  Theorem  7.1 

applies.  This  leads  one  to  suspect  that  (7.5)  la  equal  to 
2  A 

o  (Yj(f ))/Etj.  Indeed,  this  kind  of  result  is  frequently  Implicitly 
used  in  constructing  consistent  variance  estimates  for  stationary 
processes  as  they  arise,  for  example,  in  simulation;  see  FISHMAN 
(1978),  p.  262. 

(7.6)  PROPOSITION.  Suppose  that  (Zg)  is  a  positive  recurrent 
aperiodic  regenerative  process  with  0  <  o2(Yj(|f|))  <  •, 

Bx|f(X)|  <  •.  Then,  if  the  series  (7.5)  converges  absolutely  to  a 
positive  constant, 

(7.7)  o2(f(Y0))  +  2  J  cov(f(Y0),  f(Yk»  -  o^Y^f))/*^  • 


Proof.  By  Proposition  6.10,  the  process  {Yn}  is  strong  mixing 
with  mixing  constants  a(n)  *•  o(n-^).  Then,  since 
(1+6)/ (2+6)  >  1/2,  it  follows  that 

l  a(n)Cl+6)/(2+6)  <  -  . 

n-1 

2 

Furthermore,  since  the  left  side  of  (7.7),  call  it  a. ,  converges 
absolutely, 
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°2(  I  -  o\  >  0 

k-0  K  1 

(see  [3],  p.  172),  and  thus  Corollary  5.3  of  HALL  and  HEYDE  (1980) 
applies,  yielding  the  CLT 

l  f(Y. )/n1/2  ->  N(0,  ah  . 
k-0  L 

On  the  other  hand,  as  discussed  above, 

l  f(Y.  )/n1/2  ->  N(0,  ah 
k-0  1 

2  2 

where  a^  m  a  (Yj(f))/Etj,  proving  the  result.  I 

A  corresponding  theorea  for  the  periodic  case  can  be  obtained  by 
considering  the  process  {0*}  (see  remarks  following  Corollary 
5.10).  Note  that  all  countable  state  positive  recurrent  Markov  chains 
are  positive  recurrent  regenerative  processes.  Proposition  7.6,  In 
such  a  context,  yields  a  result  complementary  to  Theorem  3,  p.  102,  of 
CHONG  (1967). 
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8.  A  Splitting  Property  of  a  Certain  Claes  of  Regeneration  Times 
A  random  time  T  is  said  to  be  a  splitting  time  for  the  process 
{Xq:  n  0}  if  for  each  n  1, 

i 

(8.1)  {T  ■  n)  ■  C  ft  D  a.s. 

n  n 

where  C  c  F?,  D  c  F*  (see  JACOBSEN  (1974)  for  details).  Our  main 
n  — u  n  - n 

goal  in  this  section  is  to  show  that  for  a  reasonably  general  class  of 
Markov  chains,  a  strong  regeneration  time  must  necessarily  be  a 
splitting  time.  This,  in  turn,  will  allow  us  to  totally  characterize 
the  nature  of  the  strongly  regenerative  chains  in  the  class. 

He  start  by  assuming  that  (Xq)  Is  a  Markov  chain  taking 
values  in  a  measurable  space  (E ,E) ,  where  IJ  is  the  class  of  Borel 
sets  of  the  complete,  separable  metric  space  E.  He  shall  further 
require  that  the  transition  kernel  Q  of  the  process  { Xn }  is 
X -continuous  in  the  sense  that  Q(x,»)  is  absolutely  continuous  with 
respect  to  some  fixed  o-flnlte  reference  measure  X(*),  for  each  x 
in  E.  Hence,  by  Proposition  5.1  of  [29],  one  may  write  Q  as 

Q(x,B)  -  /  q(x,y)  \(dy) 

B 

where  q  is  jointly  measurable  in  the  product  o-field  £  *  E. 

As  is  well-known  in  Markov  chain  theory,  the  process  {Xq}  may 
be  represented  as  the  measurable  coordinate  projections  on  the  product 
space  Q  ■  E  x  E  x  •••  .  Then,  for  each  p  on  (E,JJ),  the  chain 
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Xq  Induces  s  probability  on  Q  corresponding  to  the  chain 

Q.1  m 

started  with  Initial  distribution  p.  Putting  Eg  ,  equal  to  the 

c-fielda  generated  by  the  first  n  coordinates  and  the  reaalnlng 

1  2 

coordinates,  respectively,  we  let  Q^(dx),  Q^(dy)  be  the  "marginal” 
measures  defined  by 

(8.2)  qJ(A)  -  <y<X0.  ...,  X^)  e  A),  A  «  eJ‘1 

<£<*>- Vrt» . Vi> 5  “i 

Our  first  result  is  the  following. 

(8.3)  PROPOSITION.  If  {Zq:  n  >  0}  is  X-continuous ,  then  there 
exists  a  jointly  measurable  function  f(x,y)  such  that 

Q^(dx,  dy)  -  f(x,y)  Q^(dx)  Q*(dy) 

Proof.  Let  Qz(dy)  be  the  probability  on  Q  associated  with 
Xo  ■  z.  Then,  the  Harkov  property  of  {Xq}  allows  one  to  write 

Q^Cdx,  dy)  -  /  X(dz)  Q^(dx)  q(x,r)  Q^dy)  . 

Thus,  for  a  rectangle  A  x  B  (A  e  E?-*,  B  e  E*),  we  have,  by  Fublnl, 


where 


Q  (A  *  B)  -  /  X(dz)  Q  (B)  /  Q^(dx)  q(x,s) 


-  /  X(dz)  Qa(B)  /  Q^(dx)  q(x,z)  I{h(z)>0} 
E  A 


h(z)  ■  /  Q*(dx)  q(x,z) 
„n-l  ^ 


Hence,  for  any  rectangle  A  x  B, 


(8.4) 


Q^(A  x  B)  -  Q£(A  x  B) 


where  Q*  la  defined  by 


(8.5)  QJ(di.  dy)  -  /  X(d.)  «t(dy)  qj(dx)  hU>  I(h(t))#} 


This  measure  is?  clearly  absolutely  continuous  with  respect  to 


(8.6) 


-  Q^(dx)  q*(dy) 


Since  the  rectangles  generate  the  product  onfield  on  Q,  it 
follows,  by  (8.4),  that  q^  -  q£.  Thus,  the  Radon-Nikodym  theorem, 
applied  to  (8.S)  and  (8.6),  concludes  the  proof.  I 
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(8.7)  THEOREM.  Let  Tfc  be  a  regeneration  tlan  for  e  X-contlnwme 
Markov  chela.  Then,  e.e. , 

I(<V<Tk-l,o>  >  °> 

"  I<yv°ipo’1>  >  °> 1  <y  v»|£>  >  0) 

where 

■  B(Xj  »  •  •  • »  * 

Proof.  Let  P*  be  the  probability  on  (E“.E“)  defined  by 


(8.8)  P*<A)  *  %(v0  *  A!  \  ‘  *>'«,«*  *  nl 

.here  Vj  -  (Xj.  *J+1.  ... )•  »>«  lf  A  1  4"‘-  *  *  the° 

(8.9)  Q^{T  -  n)  •  P*(AB)  -  Q^UXq*  •••»  Xn-1?  c  A»  Va  c  B;  \  “  n} 


by  the  regenerative  property.  But 


V’n  8  »>  \  m  »>  '  VVT,  4  *'  QA  ‘ 

and  thus  (8.8)  becomes 

(8.10)  P*(AB)  -  P*(A)  P*(B)  . 

Let  P^,  F£  be  the  marginal  measures  of  P*  on 

respectively,  and  observe  that  (8.10)  Implies  that  P*  equals  the 

product  measure  P*  x  p*  on  an  algebra  generating  .  Thus, 

(8.11)  P*(C)  -  /  (/  Ic(x,y)  P*(dx)J  P*(dy>  . 

Now,  P*  <  Pj  and  P*  <  P2  where  P^ ,  P2  are  the  marginal  measures 
of  P  on  (Q^  <  Q2  means  that  Q1  Is  absolutely  continuous  with 

respect  to  Q2).  Hence,  by  the  Radon-Nlkodym  theorem, 

P*(dx)  -  hx(x)  PL(dx) 

P*(dx)  -  h2(x)  P2(dx) 

for  appropriately  measurable  h|  and  h2>  So,  from  (8.11),  we  get 

(8.12)  P*(C)  -  /  (/  Ic(x,y)  h^x)  h^y)  P2(dy)J  P^dx)  . 
Proposition  (8.2)  then  shows  that 
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(8.13) 


P'(dx,  dy)  -  f(x,y)  Pj(dx)  P2(dy)  . 

We  now  use  the  fact  that  P*  <  P' ,  so  that 

(8.14)  P*(dx,dy)  -  h(x,y)  P'(dx,  dy)  . 

Combining  (8.12)  through  (8.14)  proves  that 

h(x,y)  f(x,y)  -  hj,(x)  h2(y) 

P^  *  P2  a. s.  The  absolute  continuity  of  P  with  respect  to  P^  x  p^ 
gives 

(8.15)  h(x,y)  -  h^(x)  h2(y)/f(x,y) 

P  a.s.  (we  Interpret  the  quotient  as  zero  if  the  denominator 
vanishes).  Now  observe  that 

h((XQ,  ....  Xo-1),  Vq)  -  P{Tk  -  n|pJJ}  a.s. 

hl^X0’  ***’  Xn-P  "  P^Tk  “  °|lo  *  a,s* 

h2(Vn>  ’  ’  n|i>  • 

Thus,  (8.15)  proves  the  theorem.  I 
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Equation.  (8.16)  can  ba  used  to  characterise  the  class  of  strongly 
regenerative  X-coutinuous  Markov  chains. 

(8.17)  THEOREM.  Let  {Xq)  be  a  X-continuous  Markov  chain,  with 
transition  kernel  Q,  taking  values  in  a  complete  separable  nettle 
space.  Then,  the  following  are  equivalent: 

1)  (Xq)  is  a  strongly  regenerative  process  under  initial 
distribution  p. 

ii)  there  exist  sets  A,B  e  E  such  that  Q  {(X  ,  ,X  )  e  A  x  B 

—  |i  n 

i.o. }  -  1  and 

Q(x,  B  ft  C)  -  6(C)  Q(x,B) 

for  all  x  e  A  and  C  e  JE,  where  ^  1>  a  weasure  on  (E,E). 


Proof.  We  first  prove  that  (1)  Implies  (11).  Select  n  so  that 
0^(12  *  n}  >0,  let  g  e  bl!,  and  consider 

VZg(Xn);  T2  "  n> 


3 


(8.18) 


where  Z  is  an  arbitrary  bounded  function  aeaaurable  with  reapect  to 
•  _B(Xq,  •••,  xn_p*  ®y  Markov  property  and  (8.16),  (8.18) 
can  be  written  as 

(8.19)  E{Zg(X )  L,  L,  > 

»  n  rl  r2 

*  Vz  Ir1  8<x»’  \{h\£l» 

-  yz  ^  «<y  "«„» 

■  Vz  \  Vg(V  h<VlVi» 

■  V2  yew  <Vi» 

where  h(XQ)  -  a°d  Qf  ls  defined,  for  f  e  bE,  by  the 

formula 


(Qf)(y)  -  /  f(*)  Q(y,dz)  . 


On  the  other  hand,  the  regenerative  property  dictates  that  (8.18)  Is 
equal  to 
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(8.20)  E{Z;  T  -  n>  E  g(L  ) 

H-  *  l*  Lz 

-  VZ  Vj  MV  V(V> 

*  V2  ‘riWh>(Xo-l)  E„*(XT2,)  • 

It  follows  that  on  Tj,  and  hence  on  {T  -  n}» 

(8.21)  (QghJOj  x)  -  (QhXX^)  E^gCX^) 

a.s. ,  for  g  c  bE.  Now,  _E  is  separable,  so  it  is  generated  by 
a  countable  algebra  ,  C^,  .....  By  (8.21),  Q^(A)  **  * 

where 

A  -  {(Qgh)(XT  _t)  -  (Qh)(XT  _j)  E^g(XT  )  for  g  -  Ic  for  all  k}  , 
2  2  2  k 

and  thus  for  v  a.e.  x 

(8.22)  (Qgh)(x)  -  (Qh)(x)  E  g(X_  ) 

\i  Lz 

simultaneouly  over  all  g  e  blZ,  where  v(dx)  ■  C  ***’  ^2  *  n^* 

Let  B  »  (y:  h(y)  >  0},  and  observe  that  if  g(y)  ■  IgCy)  g(y) »  then 

(8.22)  gives 

(8.23)  (Qg)(x)  -  (Qh)(x)  E^  gUj  J/hO^  )  • 

Letting  ii(dy)  -  e  dy)  ,  we  see  that  (8.23)  yields 
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(8.24) 


fOT  7  6  B  , 


■ 


Q(x,dy)  -  nUy)/h(y) 

where  cx  is  a  constant.  Let  $(dy)  m  c»ti(dy)/h(y) ,  where  c  is  a 
normalization  which  makes  $  a  probability.  By  (8.24),  we  have 

(8.25)  Q(x,  C  n  B)  -  cx  <(>(C) 

where  c  *  c  /c.  Putting  C  equal  to  B  reveals  that  c  “  Q(*»B). 
xx  * 

Finally,  recall  that,  by  absolute  continuity, 

v(dx)  -  k(x)  (^{X^,  _x  c  dx)  . 

Putting  A  -  (x:  k(x)  >  0) ,  we  see  that  • 

Q,{(*-  X_  )  e  A  x  B>  >  0 

Vi  l2  i  1-2 


and  thus 

y(Xn.j,  Xn)  c  A  X  B  i.o.)  -  1  , 

finishing  the  proof  of  (i)  implying  (ii). 

For  the  converse,  let  Tq  *  0  and  put 

V! '  Inf(k  >  V“  °W  V  «  *  »  » 

For  Z,  e  WsjT1,  g  e  bE*.  the  Markov  property  proves  that 
1  ~~ 
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(8.26)  lyZj  s(Vk);  Tj  -  k> 

-  S^lZj  g(Vfc);  ti_l  e  A,  e  B} 

‘  E„(Z1  \.l<«(T2>i  X1  '  B>=  Vl  *  *> 

'  VZ1  PJtk_1,Xl  6  B,!  Vl  «  *>  e,(8(V0)( 

•  yy  Ti  ■  k>  y«<v>  • 

Put  Zj  ■  1  in  (8.26)  and  sum  over  all  k  in  (8.26);  this  shows 

that  E^{g(Vg)}  ■  E^{g(VT  )} ,  and  yields  the  Independence  of  Hq  and 
00 

vk-l  — k*  inductive  argument  proves  that  the  entire  collection 

is  independent.  For  the  identically  distributed  property  (2.1)(ii), 
repetition  of  (8.22)  for  Tn  proves  that  for  all  n  1, 

y«<v>  ■  y^'r »  • 

r  n 

In  particular,  setting 

S(v)  "  IC(v0 . Vk-1>  Vvp  IB(vk) 

shows  that 


E  { (X_  i  . . • i  X_  , .  - )  c  C;  x  *  k) 
Li  T  T  +k-l  n 

^  n  n 

have  a  common  value,  proving  (2.1)(ii).  I 
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This  theor*  t  shows  that  1 £  a  X-continuous  Markov  chain  la 
strongly  regenerative,  then  one  can  choose  the  regeneration  tinea  to 
be  stopping  tines  with  respect  to  the  process  fields.  This  result 
extends,  in  a  certain  sense,  to  Markov  chains  that  are  weakly 
regenerative;  see  [19].  For  some  related  results  on  splitting  times 
tor  countable  state  Markov  chains,  we  refer  the  reader  to  JACOBSEN  and 
PITMAN  (1977). 


' 
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